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Foreword 

This Technical Specification (TS) has been produced by ETSI 3rd Generation Partnership Project (3GPP). 

The present document may refer to technical specifications or reports using their 3GPP identities, UMTS identities or 
GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables. 

The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under 
http://webapp.etsi.org/kev/quervform.asp . 
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Foreword 



rd , 



This Technical Specification has been produced by the 3 Generation Partnership Project (3GPP). 

The contents of the present document are subject to continuing work within the TSG and may change following formal 
TSG approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG with an 
identifying change of release date and an increase in version number as follows: 

Version x.y.z 

where: 

X the first digit: 

1 presented to TSG for information; 

2 presented to TSG for approval; 

3 Indicates TSG approved document under change control. 

y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections, 
updates, etc. 

z the third digit is incremented when editorial only changes have been incorporated in the specification; 
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Scope 



The present document defines the character sets, languages and message handhng requirements for SMS, CBS and 
USSD and may additionally be used for Man Machine Interface (MMI) (3GPP TS 22.030 [2]). 

The specification for the Data Circuit terminating Equipment/Data Terminal Equipment (DCE/DTE) interface 
(3GPP TS 27.005 [8]) will also use the codes specified herein for the transfer of SMS data to an external terminal. 



References 



The following documents contain provisions which, through reference in this text, constitute provisions of the present 
document. 

• References are either specific (identified by date of publication, edition number, version number, etc.) or 
non-specific. 

• For a specific reference, subsequent revisions do not apply. 

• For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including 
a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same 
Release as the present document. 

[I] void 

[2] 3GPP TS 22.030: "Man-Machine Interface (MMI) of the User Equipment (UE)". 

[3] 3GPP TS 23.090: "Unstructured Supplementary Service Data (USSD) - Stage 2". 

[4] 3GPP TS 23.040: "Technical reahzation of the Short Message Service (SMS) ". 

[5] 3GPP TS 23.041: "Technical reahzation of Cell Broadcast Service (CBS)". 

[6] 3GPP TS 24.01 1 : "Point-to-Point (PP) Short Message Service (SMS) support on mobile radio 

interface". 

[7] Void. 

[8] 3GPP TS 27.005: "Use of Data Terminal Equipment - Data Circuit terminating Equipment (DTE - 

DCE) interface for Short Message Service (SMS) and Cell Broadcast Service (CBS)". 

[10] ISO/IEC 10646: "Information technology; Universal Multiple-Octet Coded Character Set (UCS)". 

[II] 3GPP TS 24.090: "Unstructured Supplementary Service Data (USSD); Stage 3". 
[12] ISO 639: "Code for the representation of names of languages". 

[13] 3GPP TS 23.042: "Compression algorithm for text messaging services". 

[14] 3GPP TR 21.905: "Vocabulary for 3GPP Specifications". 

[15] "Wireless Datagram Protocol Specification", Wireless Application Protocol Forum Ltd. 

[16] ISO 1073-1 and ISO 1073-2 Alphanumeric character sets for optical recognition - Parts 1 and 2: 

Character sets OCR- A and OCR-B, respectively - Shapes and dimensions of the printed image. 

[ 1 7] 3GPP TS 3 1 . 1 02: 'Characteristics of the USIM apphcation' 

[18] 3GPP TS 51.01 1 Release 4 (version 4.x.x): 'Specification of the Subscriber Identity Module - 

Mobile Equipment (SIM - ME) interface' 
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3 Abbreviations and definitions 

For the purposes of the present document, the following terms and definitions apply: 

National Language Identifier: A code representing a specific language and thereby selecting a specific National 
Language Table. 

National Language Locking Shift Table: A national language table which replaces the GSM 7 bit default alphabet 
table in the case where the locking shift mechanism as defined in subclause 6.2.1.2.3 is used. 

National Language Single Shift Table: A national language table which replaces the GSM 7 bit default alphabet 
extension table in the case where the single shift mechanism as defined in subclause 6.2.1.2.2 is used. 

National Language Table: A table containing the characters of a specific national language. 

For the purposes of the present document, the abbreviations used in the present document are listed in 3GPP TR 21.905 

[14]. 
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SMS Data Coding Scheme 



The TP -Data-Coding-Scheme field, defined in 3GPP TS 23.040 [4], indicates the data coding scheme of the TP-UD 
field, and may indicate a message class. Any reserved codings shall be assumed to be the GSM 7 bit default alphabet 
(the same as codepoint 00000000) by a receiving entity. The octet is used according to a coding group which is 
indicated in bits 7. .4. The octet is then coded as follows: 



Coding Group Bits 
7..4 


Use of bits 3..0 


OOxx 


General Data Coding indication 
Bits 5..0 indicate the following: 

Bit 5, if set to 0, indicates the text is uncompressed 

Bit 5, if set to 1 , indicates the text is compressed using the compression algorithm defined 

in 3GPPTS 23.042 [13] 

Bit 4, if set to 0, indicates that bits 1 to are reserved and have no message class 

meaning 

Bit 4, if set to 1 , indicates that bits 1 to have a message class meaning:: 

Bit 1 Bit Message Class 
Class 

1 Class 1 Default meaning: ME-specific. 

1 Class 2 (U)SIM specific message 

1 1 Class 3 Default meaning: IE specific (see 3GPPTS 27.005 [8]) 

Bits 3 and 2 indicate the character set being used, as follows : 

Bit 3 Bit2 Character set: 

GSM 7 bit default alphabet 

1 8 bit data 

1 UCS2(16bit)[10] 
1 1 Reserved 

NOTE: The special case of bits 7..0 being 0000 0000 indicates the GSM 7 bit default 
alphabet with no message class 


01 XX 


Message Marked for Automatic Deletion Group 

This group can be used by the SM originator to mark the message ( stored in the ME or 

(U)SIM ) for deletion after reading irrespective of the message class. 

The way the ME will process this deletion should be manufacturer specific but shall be 

done without the intervention of the End User or the targeted application. The mobile 

manufacturer may optionally provide a means for the user to prevent this automatic 

deletion. 

Bit 5..0 are coded exactly the same as Group OOxx 


1000.. 1011 


Reserved coding groups 


1100 


Message Waiting Indication Group: Discard Message 

The specification for this group is exactly the same as for Group 1 101 , except that: 

after presenting an indication and storing the status, the ME may discard the contents 
of the message. 

The ME shall be able to receive, process and acknowledge messages in this group, 
irrespective of memory availability for other types of short message. 


1101 


Message Waiting Indication Group: Store Message 

This Group defines an indication to be provided to the user about the status of types of 
message waiting on systems connected to the GSM/UMTS PLMN. The ME should present 
this indication as an icon on the screen, or other MMI indication. The ME shall update the 
contents of the Message Waiting Indication Status on the SIM (see 3GPP TS 51 .01 1 [1 8]) 
or USIM (see 3GPP TS 31.102 [17]) when present or otherwise should store the status in 
the ME. In case there are multiple records of EFmwis this information shall be stored within 
the first record. The contents of the Message Waiting Indication Status should control the 
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Coding Group Bits 
7..4 


Use of bits 3..0 




IVIE indicator. For each indication supported, the mobile may provide storage for the 
Origination Address. The IVIE may take note of the Origination Address for messages in 
this group and group 1 1 00. 

Text included in the user data is coded in the GSIVI 7 bit default alphabet. 
Where a message is received with bits 7..4 set to 11 01 , the mobile shall store the text of 
the SMS message in addition to setting the indication. The indication setting should take 
place irrespective of memory availability to store the short message. 

Bits 3 indicates Indication Sense: 

Bits 

Set Indication Inactive 

1 Set Indication Active 

Bit 2 is reserved, and set to 

Bit 1 Bit Indication Type: 

Voicemail IVIessage Waiting 

1 Fax IVIessage Waiting 

1 Electronic IVIail Message Waiting 
1 1 Other Message Waiting* 

* Mobile manufacturers may implement the "Other Message Waiting" indication as an 
additional indication without specifying the meaning. 


1110 


Message Waiting Indication Group: Store Message 

The coding of bits 3..0 and functionality of this feature are the same as for the Message 
Waiting Indication Group above, (bits 7..4setto 1101) with the exception that the text 
included in the user data is coded in the uncompressed UCS2 character set. 


1111 


Data coding/message class 
Bit 3 is reserved, set to 0. 

Bit 2 Message coding: 

GSM 7 bit default alphabet 

1 8-bit data 

Bit 1 Bit Message Glass: 
Glass 

1 Class 1 default meaning: ME-specific. 

1 Class 2 (U)SIM-specific message. 

1 1 Class 3 default meaning: TE specific (see 3GPP TS 27.005 [8]) 



GSM 7 bit default alphabet indicates that the TP-UD is coded from the GSM 7 bit default alphabet given in 

clause 6.2.1. When this character set is used, the characters of the message are packed in octets as shown in 

clause 6.1.2.1.1, and the message can consist of up to 160 characters. The GSM 7 bit default alphabet shall be supported 

by all MSs and SCs offering the service. If the GSM 7 bit default alphabet extension mechanism is used then the 

number of displayable characters will reduce by one for every instance where the GSM 7 bit default alphabet extension 

table is used. 8-bit data indicates that the TP-UD has user-defined coding, and the message can consist of up to 

140 octets. 

UCS2 character set indicates that the TP-UD has a UCS2 [10] coded message, and the message can consist of up to 
140 octets, i.e. up to 70 UCS2 characters. The General notes specified in clause 6.1.1 override any contrary 
specification in UCS2, so for example even in UCS2 a <CR> character will cause the MS to return to the beginning of 
the current line and overwrite any existing text with the characters which follow the <CR>. 

When a message is compressed, the TP-UD consists of the GSM 7 bit default alphabet or UCS2 character set 
compressed message, and the compressed message itself can consist of up to 140 octets in total. 

When a mobile terminated message is class and the MS has the capability of displaying short messages, the MS shall 
display the message immediately and send an acknowledgement to the SC when the message has successfully reached 
the MS irrespective of whether there is memory available in the (U)SIM or ME. The message shall not be automatically 
stored in the (U)SIM or ME. 
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The ME may make provision through MMI for the user to selectively prevent the message from being displayed 
immediately. 

If the ME is incapable of displaying short messages or if the immediate display of the message has been disabled 
through MMI then the ME shall treat the short message as though there was no message class, i.e. it will ignore bits 
and 1 in the TP-DCS and normal rules for memory capacity exceeded shall apply. 

When a mobile terminated message is Class 1, the MS shall send an acknowledgement to the SC when the message has 
successfully reached the MS and can be stored. The MS shall normally store the message in the ME by default, if that is 
possible, but otherwise the message may be stored elsewhere, e.g. in the (U)SIM. The user may be able to override the 
default meaning and select their own routing. 

When a mobile terminated message is Class 2 ((U)SIM-specific), an MS shall ensure that the message has been 
transferred to the SMS data field in the (U)SIM before sending an acknowledgement to the SC. The MS shall return a 
"protocol error, unspecified" error message (see 3GPP TS 24.01 1 [6]) if the short message cannot be stored in the 
(U)SIM and there is other short message storage available at the MS. If all the short message storage at the MS is 
already in use, the MS shall return "memory capacity exceeded". This behaviour applies in all cases except for an MS 
supporting (U)SIM Application Toolkit when the Protocol Identifier (TP-PID) of the mobile terminated message is set 
to "(U)SIM Data download" (see 3GPP TS 23.040 [4]). 

When a mobile terminated message is Class 3, the MS shall send an acknowledgement to the SC when the message has 
successfully reached the MS and can be stored, irrespectively of whether the MS supports an SMS interface to a TE, 
and without waiting for the message to be transferred to the TE. Thus the acknowledgement to the SC of a TE-specific 
message does not imply that the message has reached the TE. Class 3 messages shall normally be transferred to the TE 
when the TE requests "TE-specific" messages (see 3GPP TS 27.005 [8]). The user may be able to override the default 
meaning and select their own routing. 

The message class codes may also be used for mobile originated messages, to provide an indication to the destination 
SME of how the message was handled at the MS. 

The MS will not interpret reserved or unsupported values but shall store them as received. The SC may reject messages 
with a Data Coding Scheme containing a reserved value or one which is not supported. 
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CBS Data Coding Scheme 



The CBS Data Coding Scheme indicates the intended handling of the message at the MS, the character set/coding, and 
the language (when applicable). Any reserved codings shall be assumed to be the GSM 7 bit default alphabet (the same 
as codepoint 00001 111) by a receiving entity. The octet is used according to a coding group which is indicated in bits 
7. .4. The octet is then coded as follows: 



Coding Group 

Bits 

7..4 


Useof bits3..0 


0000 


Language using the GSM 7 bit default alphabet 

Bits 3..0 indicate the language: 

0000 German 

0001 English 

0010 Italian 

001 1 French 

0100 Spanish 

0101 Dutch 

0110 Swedish 

0111 Danish 

1000 Portuguese 

1001 Finnish 

1010 Norwegian 

1011 Greek 

1100 Turkish 

1101 Hungarian 

1110 Polish 

1111 Language unspecified 


0001 


0000 GSM 7 bit default alphabet; message preceded by language indication. 

The first 3 characters of the message are a two-character representation of the 
language encoded according to ISO 639 [12], followed by a CR character. The 
CR character is then followed by 90 characters of text. 

0001 UCS2; message preceded by language indication 

The message starts with a two GSM 7-bit default alphabet character 
representation of the language encoded according to ISO 639 [12]. This is padded 
to the octet boundary with two bits set to and then followed by 40 characters of 
UCS2-encoded message. 

An MS not supporting UCS2 coding will present the two character language 
identifier followed by improperly interpreted user data. 

0010..1111 Reserved 


0010.. 


0000 Czech 

0001 Hebrew 

0010 Arabic 

0011 Russian 

0100 Icelandic 

01 01 ..1111 Reserved for other languages using the GSM 7 bit default alphabet, with 

unspecified handling at the MS 


0011 


0000. .1 1 1 1 Reserved for other languages using the GSM 7 bit default alphabet, with 
unspecified handling at the MS 
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Coding Group 

Bits 

7..4 


Useof bits3..0 


01 XX 


General Data Coding indication 
Bits 5..0 indicate the following: 

Bit 5, if set to 0, indicates the text is uncompressed 

Bit 5, if set to 1 , indicates the text is compressed using the compression algorithm defined in 

3GPPTS 23.042 [13] 

Bit 4, if set to 0, indicates that bits 1 to are reserved and have no message class meaning 
Bit 4, if set to 1 , indicates that bits 1 to have a message class meaning: 

Bit 1 Bit Message Class: 
Class 

1 Class 1 Default meaning: ME-specific. 

1 Class 2 (U)SIM specific message. 

1 1 Class 3 Default meaning: TE-specific (see 3GPP TS 27.005 [8]) 

Bits 3 and 2 indicate the character set being used, as follows: 

Bit 3 Bit 2 Character set: 

GSM 7 bit default alphabet 

1 8 bit data 

1 UCS2(16bit)[10] 
1 1 Reserved 


1000 


Reserved coding groups 


1001 


Message with User Data Header (UDH) structure: 

Bit 1 Bit Message Class: 
Class 

1 Class 1 Default meaning: ME-specific. 

1 Class 2 (U)SIM specific message. 

1 1 Class 3 Default meaning: TE-specific (see 3GPP TS 27.005 [8]) 

Bits 3 and 2 indicate the alphabet being used, as follows: 

Bit 3 Bit 2 Alphabet: 

GSM 7 bit default alphabet 

1 8 bit data 

1 USC2(16bit)[10] 
1 1 Reserved 


1010.. 1101 


Reserved coding groups 


1110 


Defined by the WAP Forum [1 5] 


1111 


Data coding / message handling 
Bit 3 is reserved, set to 0. 

Bit 2 Message coding: 

GSM 7 bit default alphabet 

1 8 bit data 

Bit 1 Bit Message Class: 
No message class. 

1 Class 1 user defined. 

1 Class 2 user defined. 
1 1 Class 3 

default meaning: TE specific 
(see 3GPP TS 27.005 [8]) 



These codings may also be used for USSD and MMI/display purposes. 

See 3GPP TS 24.090 [1 1] for specific coding values applicable to USSD for MS originated USSD messages and MS 
terminated USSD messages. USSD messages using the default alphabet are coded with the GSM 7-bit default alphabet 
given in clause 6.2.1. The message can then consist of up to 182 user characters. 

Cell Broadcast messages using the default alphabet are coded with the GSM 7-bit default alphabet given in clause 6.2.1. 
The message then consists of 93 user characters. 
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If the GSM 7 bit default alphabet extension mechanism is used then the number of displayable characters will reduce by 
one for every instance where the GSM 7 bit default alphabet extension table is usedCell Broadcast messages using 8-bit 
data have user-defined coding, and will be 82 octets in length. 

UCS2 character set indicates that the message is coded in UCS2 [10]. The General notes specified in clause 6.1.1 
override any contrary specification in UCS2, so for example even in UCS2 a <CR> character will cause the MS to 
return to the beginning of the current line and overwrite any existing text with the characters which follow the <CR>. 
Cell Broadcast messages encoded in UCS2 consist of 41 characters. 

Class 1 and Class 2 messages may be routed by the ME to user-defined destinations, but the user may override any 
default meaning and select their own routing. 

Class 3 messages will normally be selected for transfer to a TE, in cases where a ME supports an SMS/CBS interface to 
a TE, and the TE requests "TE-specific" cell broadcast messages (see 3GPP TS 27.005 [8]). The user may be able to 
override the default meaning and select their own routing. 

Messages with a User Data Header Structure are encoded as described in 3GPP TS 23.040 [4] for SMS, in subclauses 
3.10 and 9.2.3.24. 

The use of Cell Broadcast DCS values for messages with a User Data Header structure implies that the 82-bytes CB 
payload has a User Data Header structure. 

The CBS message information field will contain the lEs as described in 3GPP TS 23.040. The concatenation lEs will 
not be used, as CB concatenation will rely in that case on the existing CB mechanism. Note that lEs that cannot be split 
and that lEs that are too large to fit in one CB segment cannot be transmitted using this mechanism. Also, some lEs as 
defined for SMS are not applicable for CB: 



VALUE 
(hex) 


MEANING 


00 


Concatenated short messages, 8-bit reference number 


01 


Special SIVIS Message Indication 


06 


SIVISC Control Parameters 


08 


Concatenated short message, 16-bit reference number 


20 


RFC 822 E-Mail Header 


23 


Enhanced Voice Mail Information 


70-7F 


(U)SIM Toolkit Security Headers 


80-89 


SME to SME specific use 



6 Individual parameters 

6.1 General principles 
6.1.1 General notes 

Except where otherwise indicated, the following shall apply to all character sets: 

1: The characters marked "1)" are not used but are displayed as a space. 

2: The characters of this set, when displayed, should approximate to the appearance of the relevant characters 
specified in ISO 1073 [16]and the relevant national standards. 

3: Control characters: 
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Code 


Meaning 


LF 


Line feed: Any characters following LF which are to be displayed shall be presented as the next line 
of the message, commencing with the first character position. 


CR 


Carriage return: Any characters following CR which are to be displayed shall be presented as the 
current line of the message, commencing with the first character position. 


SP 


Space character. 



4: The display of characters within a message is achieved by taking each character in turn and placing it in the next 
available space from left to right and top to bottom. 

6.1 .2 Character packing 

6.1.2.1 SMS Packing 

6.1.2.1.1 Packing of 7-bit characters 

If a character number a is noted in the following way: 

b7 b6 b5 b4 b3 b2 bl 
aa ab ac od ae af ag 
The packing of the 7-bitscharacters in octets is done by completing the octets with zeros on the left. 

For examples, packing: a 

one character in one octet: 

bits number: 

7 6 5 4 3 2 10 
la lb Ic Id le If Ig 

two characters in two octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
2a 2b 2c 2d 2e 2f 

three characters in three octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
3a 3b 3c 3d 3e 

seven characters in seven octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
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7b 7c 7d 7e 7f 7g 6a 6b 
0000000 7a 

eight characters in seven octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
7b 7c 7d 7e 7f 7g 6a 6b 
8a 8b 8c 8d 8e 8f 8g 7a 

The bit number zero is always transmitted first. 

Therefore, in 140 octets, it is possible to pack (140x8)/7=160 characters. 



6.1.2.2 



CBS Packing 



6.1 .2.2.1 Packing of 7-bit characters 

If a character number a is noted in the following way: 

b7 b6 b5 b4 b3 b2 bl 
aa ab ac od ae af ag 

the packing of the 7-bits characters in octets is done as follows: 
bit number 



7 6 5 4 3 2 10 



octet number 



1 2g la lb Ic Id le If Ig 

2 3f 3g 2a 2b 2c 2d 2e 2f 

3 4e 4f 4g 3a 3b 3c 3d 3e 

4 5d 5e 5f 5g 4a 4b 4c 4d 

5 6c 6d 6e 6f 6g 5a 5b 5c 

6 7b 7c 7d 7e 7f 7g 6a 6b 

7 8a 8b 8c 8d 8e 8f 8g 7a 

8 lOg 9a 9b 9c 9d 9e 9f 9s 



81 93d 93e 93f93g 92a 92b 92c 

82 93a 93b 93c 



92d 



The bit number zero is always transmitted first. 

Therefore, in 82 octets, it is possible to pack (82x8)/7 = 93.7, that is 93 characters. The 5 remaining bits are set to zero 
as stated above. 

6.1.2.3 USSD packing 

6.1 .2.3.1 Packing of 7 bit characters 

If a character number a is noted in the following way: 

b7 b6 b5 b4 b3 b2 bl 
aa ab ac ad ae af ag 
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The packing of the 7-bit characters in octets is done by completing the octets with zeros on the left. 

For example, packing: a 

one character in one octet: 

bits number: 

7 6 5 4 3 2 10 
la lb Ic Id le If Ig 

two characters in two octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
2a 2b 2c 2d 2e 2f 

three characters in three octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
3a 3b 3c 3d 3e 

six characters in six octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
6a 6b 

seven characters in seven octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
7b 7c 7d 7e 7f 7g 6a 6b 
1 1 1 7a 

The bit number zero is always transmitted first. 

eight characters in seven octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
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4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
7b 7c 7d 7e 7f 7g 6a 6b 
8a 8b 8c 8d 8e 8f 8g 7a 



nine characters in eight octets: 



bits number: 



7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
7b 7c 7d 7e 7f 7g 6a 6b 
8a 8b 8c 8d 8e 8f 8g 7a 
9a 9b 9c 9d 9e 9f 9g 

fifteen characters in fourteen octets: 

bits number: 

7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
7b 7c 7d 7e 7f 7g 6a 6b 
8a 8b 8c 8d 8e 8f 8g 7a 
lOg 9a 9b 9c 9d 9e 9f 9g 
llfllg 10a 10b 10c 
12e 12fl2g 11a lib 
13d 13e 13fl3g 12a 
14c 14d 14e 14fl4g 
15b 15c 15d 15e 15i 
1 1 1 15a 



Od 


lOe 


lOf 


Ic 


lid 


lie 


2b 


12c 


12d 


3a 


13b 


13c 


5g 


14a 


14b 



sixteen characters in fourteen octets: 



bits number: 



7 6 5 4 3 2 10 
2g la lb Ic Id le If Ig 
3f 3g 2a 2b 2c 2d 2e 2f 
4e 4f 4g 3a 3b 3c 3d 3e 
5d 5e 5f 5g 4a 4b 4c 4d 
6c 6d 6e 6f 6g 5a 5b 5c 
7b 7c 7d 7e 7f 7g 6a 6b 
8a 8b 8c 8d 8e 8f 8g 7a 
lOg 9a 9b 9c 9d 9e 9f 9g 



llfllg 10a 10b 10c 


lOd 


lOe 


lOf 


12e 12fl2 


g 11a lib 


lie 


lid 


lie 


13d 13e 


13fl3g 12a 


12b 


12c 


12d 


14c 14d 


14e 14fl4g 


13a 


13b 


13c 


15b 15c 


15d 15e 15fl5g 


14a 


14b 


16a 16b 


16c 16d 16e 16fl6g 


15a 



The bit number zero is always transmitted first. 
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Therefore, in 160 octets, is it possible to pack (160*8)/7 = 182.8, that is 182 characters. The remaining 6 bits are set to 
zero as stated above. 

Packing of 7 bit characters in USSD strings is done in the same way as for SMS (clause 6.1.2.1). The character stream 
is bit padded to octet boundary with binary zeroes as shown above. 

If the total number of characters to be sent equals (8n-l) where n=l,2,3 etc. then there are 7 spare bits at the end of the 
message. To avoid the situation where the receiving entity confuses 7 binary zero pad bits as the @ character, the 
carriage return or <CR> character (defined in clause 6.1.1) shall be used for padding in this situation, just as for Cell 
Broadcast. 

If <CR> is intended to be the last character and the message (including the wanted <CR>) ends on an octet boundary, 
then another <CR> must be added together with a padding bit 0. The receiving entity will perform the carriage return 
function twice, but this will not result in misoperation as the definition of <CR> in clause 6.1.1 is identical to the 
definition of <CR><CR>. 

The receiving entity shall remove the final <CR> character where the message ends on an octet boundary with <CR> as 
the last character. 



6.2 Character sets and coding 

This section provides list of character sets and codings to be supported by SMS, CBS and USSD. Implementation of the 
GSM 7 bit default alphabet is mandatory. Support of other character sets is optional. 

It should be noted that support of Latin and non-Latin languages by GSM 7 bit default alphabet is limited. It is therefore 
essential to introduce UCS 2 character set in mobile stations, SCs and systems handling SMSs, CBSs and USSDs. 

6.2.1 GSM 7 bit Default Alpinabet 

Bits per character: 7 

CBS/USSD pad character: CR 
Character table: 
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NOTE 1): This code is an escape to an extension of this table (either to the GSIVI 7 bit default alphabet extension 
table, see subclause 6.2.1 .1 , or a National Language Single Shift Table, see subclause 6.2.1 .2.2). A 
receiving entity which does not understand the meaning of this escape mechanism shall display it as a 
space character. 



6.2.1.1 



GSM 7 bit default alphabet extension table 



The table below is reserved for symbols of international significance (e.g currency symbols). It also contains a 
mechanism to permit escape (Note 1) to additional tables for symbols of international significance in the event that the 
table below becomes fully populated. 
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In the event that an MS receives a code where a symbol is not represented in the above table then the MS shall 
display either the character shown in the main GSM 7 bit default alphabet table in subclause 6.2.1 ., or the 
character from the National Language Locking Shift Table in the case where the locking shift mechanism as 
defined in subclause 6.2.1 .2.3 is used. 
NOTE 1): This code is reserved for the extension to another extension table. On receipt of this code, a receiving 

entity shall display a space until another extension table is defined. It is not intended that this extension 

mechanism should be used as an alternative to UCS2 to enhance the 7bit default alphabet character 

repertoire for national specific character sets. 
NOTE 2): Void 
NOTE 3): This code is defined as a Page Break character and may be used for example in compressed CBS 

messages. Any mobile station which does not understand the GSM 7 bit default alphabet table 

extension mechanism will treat this character as Line Feed. 
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6.2.1.2 National Language Identifier 

6.2.1.2.1 Introduction 

The national language tables are used for adding the special characters of certain languages that cannot be expressed 
using the GSM default 7 bit alphabet. 

The principle is to use the National Language Identifier to indicate to a receiving entity that the message has been 
encoded using a national language table. Both single shift and locking shift mechanisms are defined. 

The single shift mechanism, as defined in subclause 6.2.1.2.2, applies to a single character and it replaces the GSM 7 bit 
default alphabet extension table defined in subclause 6.2.1.1 with a National Language Single Shift Table (see 
subclause A.2). 

The locking shift mechanism, as defined in subclause 6.2.1.2.3, applies throughout the message, or the current segment 
in case of a concatenated message, and it replaces the GSM 7 bit default alphabet defined in subclause 6.2. 1 with a 
National Language Locking Shift Table (see subclause A.3) that defines the whole character set needed for the 
language. 

In case that several languages are used, which require different national language tables, it is recommended to encode 
the message in UCS-2, however it is possible to use both single shift and locking shift with the corresponding tables in a 
single message. 

Implementations based on older reference versions (so-called "legacy implementations") will use the fallback 
mechanisms that are defined in the earlier versions of the specification for handling of unknown characters. 

6.2.1 .2.2 Single shift mechanism 

In the case where single shift is not combined with locking shift, single shift means that the receiving entity shall 
decode all characters in the message (or the current segment in case of a concatenated message) using the GSM 7 bit 
default alphabet unless the escape mechanism is used, i.e <escape><character>, as defined in subclause 6.2.1. 

The case where single shift and locking shift are combined is described in subclause 6.2.1.2.3. 

If the escape mechanism is used then instead of the GSM 7 bit default alphabet extension table in subclause 6.2.1.1 the 
receiving entity shall decode the subsequent character using the National Language Single Shift Table for the indicated 
language in table 6.2.1.2.4.1. Each time a sending entity requires to send a character from the National Language Single 
Shift Table the sending entity shall encode this as <escape><character>, where the <character> is encoded using the 
indicated National Language Single Shift Table. 

6.2.1 .2.3 Locking shift mechanism 

Locking Shift means that the receiving entity shall decode all characters in the message (or the current segment in case 
of a concatenated message) using the National Language Locking Shift Table unless the escape mechanism is used. i.e. 
<escape><character>, as defined in subclause 6.2.1. 

If the escape mechanism is used and no National Language Single Shift Table is indicated (see subclause 6.2.1.2.4), the 
receiving entity shall decode the message (or the current segment in case of a concatenated message) using the GSM 7 
bit default alphabet extension table as defined in subclause 6.2.1.1. 

If the escape mechanism is used and a National Language Single Shift Table is indicated (see subclause 6.2.1.2.4), the 
receiving entity shall decode the message (or the current segment in case of a concatenated message) using the National 
Language Single Shift Table as defined in subclause 6.2.1.2.2. 

6.2.1.2.4 National Language Identifier 

A National Language Single Shift IE and a National Language Locking Shift IE can be included in the TP User Data 
Header, as defined in 3GPP TS 23.040 [4]. The receiving entity shall decode using single shift or locking shift as 
applicable for the language indicated in the National Language Identifier within these lEs. 
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The National Language Identifier octet is encoded as shown in table 6.2.1.2.4.1. 

Table 6.2.1 .2.4.1 



Language code b7 bO 

00000000 
00000001 
00000010 



00000011 

00000100 to 11111111 



Language 

Reserved 

Turkish 

Spanish 



Portuguese 
Reserved 



National Language 
Single Shift Table 

n/a 

Subclause A.2.1 

Subclause A.2.2 



Subclause A.2.3 
n/a 



National Language 
Locking Shift Table 

n/a 

Subclause A. 3.1 

Not defined - fallback to 
GSM 7 bit default 
alphabet (see subclause 
6.2.1) 

Subclause A.3.3 

n/a 



6.2.1.2.5 



Processing of national language characters 



When supporting a specific national language, the sending entity shall support the encoding of messages using the 
corresponding National Language Identifier defined in subclause 6.2.1.2.4. 

The receiving entity should be able to decode messages using all National Language Identifiers defined in subclause 
6.2.1.2.4. 

If a message is received, containing a National Language Identifier indicating a reserved value or a value that is not 
supported by the receiving entity, the receiving entity shall ignore the IE (see 3GPP TS 23.040 [4]) in which the 
National Language Identifier was indicated. 

The receiving entity shall be capable of processing both single shift and locking shift within the same message. 

It is an implementation option for the sending entity whether to use the single shift mechanism, the locking shift 
mechanism or both. 

NOTE 1 : A message using the locking shift mechanism cannot make use of characters from the GSM 7 bit Default 
Alphabet table unless such characters are replicated in the National Language Locking Shift Table or (in 
the case of locking shift and single shift), the National Language Single Shift table. 

NOTE 2: Encoding of a message using the national locking shift mechanism is not intended to be implemented 

until a formal request is issued by the relevant national regulatory body. This is because a receiving entity 
not supporting the relevant locking-shift decoding will present different characters from the ones intended 
by the sending entity. 



6.2.2 8 bit data 

8 bit data is user defined 
Padding: 

Character table: 



CR in the case of an 8 bit character set 
Otherwise - user defined 
User Specific 



6.2.3 UCS2 

Bits per character: 16 

CBS/USSD pad character: CR 
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Character table: ISO/IEC 10646 [10] 
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Annex A (normative): 
National Language Tables 

A.1 Introduction 

This annex contains character tables for specific languages whose characters are not wholly or partially present within 
the GSM 7 bit default alphabet. 
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A.2 National Language Single Shift Tables 
A.2.1 Turkish National Language Single Shift Table 
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NOTE 1): This code is reserved for the extension to another extension table. On receipt of this code, a receiving 

entity shall display a space until another extension table is defined. NOTE 2): Void 
NOTE 3): This code is defined as a Page Break character and may be used for example in compressed CBS 

messages. Any mobile station which does not understand the GSIVI 7 bit default alphabet table 

extension mechanism will treat this character as Line Feed. 
NOTE 4): This code represents a control character and therefore must not be used for language specific 

characters. 
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A.2.2 Spanish National Language Single Shift Table 

NOTE: This table also includes the character "9" used in Catalan. 
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NOTE 1): This code is reserved for the extension to another extension table. On receipt of this code, a receiving 

entity shall display a space until another extension table is defined. 
NOTE 2): Void 
NOTE 3): This code is defined as a Page Break character and may be used for example in compressed CBS 

messages. Any mobile station which does not understand the GSIVI 7 bit default alphabet table 

extension mechanism will treat this character as Line Feed. 
NOTE 4): This code represents a control character and therefore must not be used for language specific 

characters. 
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A.2.3. Portuguese National Language Single Shift Table 
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NOTE 1): This code is reserved for the extension to another extension table. On receipt of this code, a receiving 

entity shall display a space until another extension table is defined. 
NOTE 2): Void. 
NOTE 3): This code is defined as a Page Break character and may be used for example in compressed CBS 

messages. Any mobile station which does not understand the GSIVI 7 bit default alphabet table 

extension mechanism will treat this character as Line Feed. 
NOTE 4): This code represents a control character and therefore must not be used for language specific 

characters. 
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A.3 National Language Locking Shift Tables 
A.3.1 Turkish National Language Locking Shift Table 
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NOTE 1): This code is an escape to an extension of this table (either to the GSIVI 7 bit default alphabet extension 
table, see subclause 6.2.1 .1 , or a National Language Single Shift Table, see subclause 6.2.1 .2.2). A 
receiving entity which does not understand the meaning of this escape mechanism shall display it as a 
space character. 
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A.3.2 Void 



A.3.3 Portuguese National Language Locking Shift Table 
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NOTE 1): This code is an escape to an extension of this table (either to the GSIVI 7 bit default alphabet extension 
table, see subclause 6.2.1 .1 , or a National Language Single Shift Table, see subclause 6.2.1 .2.2). A receiving 
entity which does not understand the meaning of this escape mechanism shall display it as a space character. 
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Annex B (informative): 

Guidelines for creating language tables 

B.1 Introduction 

This annex provides guidelines for creating language tables. 

It is recommended that the characters and their positions in the table are checked by people fluent in the appropriate 
language, and preferably endorsed by an appropriate responsible body. 

It is recommended that character positions are carefully selected so that receiving entities, which do not support the 
specific table, display symbols (glyphs) similar to the wanted symbols (glyphs) as far as possible. 



B.2 Template for Single Shift Language Tables 

The format and structure of the table below shall be used to document the Language specific character codes used in the 
National Language selection mechanism. 

It is recommended that a National Language Single Shift Table includes the characters represented in the GSM 7 bit 
default alphabet extension table (as defined in subclause 6.2.1.1) in the same character position. This ensures the 
availability of these characters in case when the single shift mechanism is used. 

Language - (Note. The actual Country and table content will be annotated 
when the country is known). 
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NOTE 1): This code is reserved for the extension to another extension table. On receipt of this code, a receiving 

entity shall display a space until another extension table is defined. 
NOTE 2): Void 
NOTE 3): This code is defined as a Page Break character and may be used for example in compressed CBS 

messages. Any mobile station which does not understand the GSIVI 7 bit default alphabet table 

extension mechanism will treat this character as Line Feed. 
NOTE 4): This code represents a control character and therefore must not be used for language specific 

characters. 



£75/ 



3GPP TS 23.038 version 8.1.0 Release 8 



32 



ETSI TS 123 038 V8.1.0 (2008-10) 



B.3 Template for Locking Shift Language Tables 

The format and structure of the table below shall be used to document the Language specific character codes used in the 
National Language selection mechanism. 

Language - (Note. The actual Country and table content will be annotated 
when the country is known). 
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NOTE 1): This code is an escape to an extension of this table (either to the GSIVI 7 bit default alphabet extension 
table, see subclause 6.2.1 .1 , or a National Language Single Shift Table, see subclause 6.2.1 .2.2). A 
receiving entity which does not understand the meaning of this escape mechanism shall display it as a 
space character. 



£75/ 



3GPP TS 23.038 version 8.1 .0 Release 8 33 ETSI TS 1 23 038 V8.1 .0 (2008-1 0) 

Annex C (Informative): 

Example for locking shift and single shift mechanisms 

C.1 Introduction 

This annex gives an overview on how the national language extension mechanism of the GSM 7 bit default alphabet 
works. This annex shows how a message with an indication of the Turkish National Language Identifier is decoded, but 
the same principles apply to other languages. 

C.2 Example of single shift 

This example outlines the behaviour of both supporting and non-supporting receiving entities where the Turkish 
National Language Single Shift Table is indicated in the received message. In this example there is no locking shift 
mechanism used in parallel. 

A non-supporting receiving entity will ignore the National Language Single Shift IE, and decode the message contents 
using the GSM 7 bit default alphabet table defined in subclause 6.2.1, including possible escape characters to the GSM 
7 bit default alphabet extension table specified in subclause 6.2.1.1. For example the Turkish word "Tiirkge" will be 
displayed as "Tiirkce". 

A receiving entity that supports the Turkish National Language Single Shift Table will detect a National Language 
Single Shift IE in a TP User Data Header. This IE tells the receiving entity that the single shift mechanism is used. 

A supporting receiving entity will notice the language code, in this example coded as '0000 0001', and therefore use the 
Turkish National Language Single Shift Table defined in subclause A. 2.1 instead of the GSM 7 bit default alphabet 
extension table defined in subclause 6.2.1. 

If the next character is any character except <escape>, then the GSM 7 bit default alphabet table is used for the decode. 
If the next character is <escape> then the Turkish language specific table is used for the decode of the one character that 
follows the <escape>. This process will be repeated until the end of the received message, or until the end of the current 
segment of a concatenated message. 

The Language selection at the start of a message takes 4 octets which correspond to five 7 bit characters which reduces 
the maximum number of characters per single message to 155. 

Thereafter, the number of characters within that single message will be dependent upon the number of times a character 
is used that is within the National Language Single Shift Table. 

Every character used from the National Language Single Shift Table will need an additional character to identify the 
escape to the National Language Single Shift Table. The available 155 character capacity of a single message will 
therefore be reduced accordingly. This reduction of overall message length also applies when using characters from the 
GSM 7 bit default alphabet extension table (see subclause 6.2.1.1) when the National Language Single Shift IE is not 
used. 



C.3 Example of locking shift 



This example outlines the behaviour of both supporting and non-supporting receiving entities where the Turkish 
National Language Locking Shift Table is indicated in the received message. 

A non-supporting receiving entity will ignore the National Language Locking Shift IE, and decode the message 
contents using the GSM 7 bit default alphabet defined in subclause 6.2.1, including possible escape characters to the 
GSM 7 bit default alphabet extensions specified in subclause 6.2.1.1. 

A receiving entity that supports the scheme will detect a National Language Locking Shift IE in a TP User Data Header. 
This IE tells the receiving entity that the locking shift mechanism is used. If no National Language Single Shift IE is 
indicated additionally to the National Language Locking Shift IE, then the whole message is decoded using the National 
Language Locking Shift Table defined for Turkish language in subclause 6.2.1.2.4.1. 
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If additionally to the National Language Locking Shift IE also a National Language Single Shift IE for the Turkish 
language is indicated, then <escape> makes an exception to the use of the National Language Locking Shift Table for 
the Turkish language. In that case a character following <escape> is decoded using the National Language Single Shift 
Table for the Turkish language, after which the use of the National Language Locking Shift Table for the Turkish 
language is resumed until the next <escape> or the end of the message is met. 

The Language selection at the start of a message takes 4 octets which corresponds to five 7 bit characters which reduces 
the maximum number of characters per single message to 155, unless the National Language Single Shift IE has also 
been included, in which case there is a further reduction of 3 octets making 7 octets in total, which corresponds to eight 
7 bit characters, which reduces the maximum number of characters per single message to 152. 

Thereafter, if the single shift mechanism is used additionally to the locking shift mechanism, the number of characters 
within that single message will be dependent upon the number of times a character is used that is within the National 
Language Single Shift Table. 

Every character in the National Language Single Shift Table will use an additional character. The available 152 
character single message length will therefore be reduced accordingly. This reduction of overall message length also 
applies when using characters from the GSM 7 bit default alphabet extension table (see subclause 6.2.1.1) when the 
National Language Single Shift IE is not used. 
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